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The  Application  of  Correlation  Matching  Technique  in  Image  Guidemce 

Min-Shou  Tang 

(  The  No.  014  research  center  of  Aviation  Industry  Corporation,  Henan, 

Luoyemg,  471009  ) 

Abstract:  This  paper  will  discuss  the  application  of  the  correlation 
oiatchlng  technique  in  image  guidance.  Through  the  analysis  and  study  of 
the  correlation  algorithm,  we  develop  the  concise  algorithm  and 
realization  method  to  meet  the  needs  of  real  time  processing.  The 
algorithm  is  tested  by  the  infrared  image  data  of  the  target.  ' 

Key  words:  MAD,  coaurse  matching,  fine  matching,  FP6A  realization 

1.  Introduction 

In  pace  with  the  application  and  advancement  of  image  processing 
technique,  correlation  matching  becomes  one  of  the  key  techniques  in  the 
area  of  information  processing.  The  application  areas  include  (1)  terrain 
contour  matching  and  map  matching  guidance  system  of  missiles,  such  as  the 
Tomahawk  cruise  missile  of  the  U.  S.  It  is  obvious  that  this  kind  of 
missile  has  a  very  high  guidemce  accuracy.  (2)  satellite  aviation 
guidance  and  satellite  navigation  guidance;  (3)  terminal  guidance  and 
homing  guidance  of  weapon  systems.  (4)  all  kinds  of  target  image  tracking 
and  target  aiming  devices,  etc.  This  paper  will  emphasize  the  accurate 
identification  of  the  aiming  point  which  is  applied  to  the  missile's 
terminal  guidance  system. 

2.  The  concept  of  correlation  matching 

The  conventional  meaning  of  correlation  matching  is: 

At  first,  using  satellites  or  reconnaissamce  planes,  ve  can  get  a  series 
of  topographic  feature  images  in  the  pre-determined  flight  path  of  the 
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aircraft,  then  store  those  images  in  the  memory  of  the  aircraft  computer. 
Those  images  are  called  reference  images.  When  the  aircraft  flies  over 
every  pre-determined  position,  the  sensor  in  the  aircraft  will  detect  the 
real  time  topographic  feature  image  (this  image  is  called  the  real  time 
image).  Thus,  we  can  compare  the  real  time  image  with  the  previously 
stored  reference  image  and  get  the  deviation  of  the  aircraft  off  the  pre¬ 
determined  flight  path,  then  output  the  signal  which  indicates  the 


deviation* 

in»D  cotMlation  matching  la  applied  to  the  terminal  guidance  and 
homing  gnldance  of  the  weapon  eyetem,  we  can  get  a  reference  Image  (al«. 
called  -template-)  and  a  real  time  image  (aleo  called  eearchlng  area)  by 


aeing  the  eame  .en«.r  at  different  time.  Ihi.  1.  a  .peclal  caee  of 


correlation  matching. 
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Terminalguidance  and  homing  guidance  are  considered  near  target 
correlation  matching.  The  target  is  usually  fill  up  or  exceeds  the  view 
area.  At  this  time,  we  can  not  get  the  correct  aiming  point,  if  a 
geometry  algorithm  or  other  methods  are  utilised.  It  is  necessary  to 
adopt  image  correlation  matching  to  resolve  this  problem. 

The  frame  .frequency  of  the  imaging  sensor  is  between  25  Hz  and  100 
Hz.  It  is  very  smooth  between  different  frames.  Thus  a  small  area  around 
the  aiming  point  in  the  last  image  frame  that  has  been  identified  can  be 
used  as  the  template  (reference  image),  an  area  in  current  image  frame  is 
used  as  the  searching  area  (real  time  image).  The  matching  point  that  we 
get  after  correlation  matching  con^putation  is  the  aiming  point  in  this 
image  frame.  Repeating  this  process  will  lead  the  aircraft  to  the  target. 


3.  Algorithm  Analysis 

He  assume  that  the  size  of  the  image  from  the  imaging  sensor  is  K  * 
L,  the  aiming  point  that  identified  in  last  image  frame  is  (xO,  yO).  We 
can  select  a  small  area  around  the  aiming  point  as  the  template,  the 
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tea^late  size  is  m  *  n,  and  we  store  the  teoiplate  data  Into  ten^late 
monory.  After  we  get  the  current  image  frame,  we  select  an  area  around 
(xO,  yO)  as  search  area,  with  the  size  M  *  M,  and  store  the  search  area 
image  data  into  the  search  memory.  Because  the  terminal  guidance  system 
detected  stablized  traclcing  (good  lock-on),  usually  (zO,  yO)  is  right  at 
the  center  of  the  viewing  field.  He  select  the  center  of  those  areas  as 
(xO,  yO),  select  m:M:K  «  1:2:4  and  n:N:L  •  1:2:4  to  make  sure  a  good 
correlation  matching  results. 


Correlation  matching  is  to  test  the  degree  of  similarity  between  the 
image  data  of  the  tinplate  emd  search  area,  the  greater  the  correlation. 
The  greater  the  similarity. 

There  are'  many  typical  algorithms  in  correlation  matching,  such  as 
Absolute  Difference  algorithm  (AD  algorithm) ,  Mean  Absolute  Difference 
algorithm  (MAD  algorithm) ,  Modulo-2  Sum  algorithm  (ZOR  algorithm) ,  Squared 
Difference  algorithm  (SD  algorithm),  Mean  Squared  Difference  algorithm 
(MSD  algorithm)  and  so  on.  Basically,  these  algorithms  have  the  minimum 
value  property.  Only  when  the  two  images  match  will  the  measure  of 
correlation  reach  the  minimum  value. 

Currently  the  correlation  matching  has  oiatu^ed  for  practical 
application.  To  meet  the  requirement  for  easy  implementation  in 
engineering,  the  algorithm  ought  to  be  simple,  accurate,  speedy.  So  the 
MAD  (mean  absolute  difference)  algorithm  is  the  best.  The  point  (x,  y) 
which  has  the  minimum  value  of  MAD, 
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confirms  that  the  real  time  image  resembles  the  reference  image  most,  this 
point  is  also  the  best  aiming  point. 

We  move  the  m  *  n  data  matrix  and  M  *  N  data  matrix  point  by  point 
to  process  MAD  computing) 

(xi,  yi)  (i  ■  1  —  P)  P  «  (M-m+l)  x  (N-n+l); 

We  need  to  perform  MAD  computation  P  times  in  all. 

We  need  to  do  m  *  n  subtractions  corresponding  to  each  point  (xi, 
yi)  and  add  up  the  absolute  value  of  these  differences  which  require  m  * 
n  absolute  value  additions.  After  computing,  the  result  value  is  the  MAD 
value  corresponding  to  the  point  (xi,  yi).  We  select  the  point  which  has 
the  minimum  MAD  value  as  the  aiming  point. 

Affected  by  noise,  interference,  and  the  change  of  grey  scale  of  the 
target  between  different  frames  and  other  factors,  the  matching  point  that 
is  computed  by  the  correlation  matching  algorithm  is  slightly  different 
from  real  matching  position.  Acting  as  the  aiming  point  of  terminal 
guidance,  the  matching  point  must  be  selected  to  avoid  a  guidance  error 
that  is  caused  by  matching  deviation.  So,  it  is  necessary  to  set  a 
threshold:  only  when  the  MAD  value  is  less  than  the  threshold,  can  the 
matching  point  be  used  as  the  aiming  point.  Otherwise,  the  aiming  point  of 
last  frame  should  be  kept.  This  method  is  practical  and  necessary  in 
situations  where  the  aircraft  is  very  close  to  the  target. 

Another  situation  that  should  be  «nphasized  is  that,  whenever  the 
target  is  partially  obscured  due  to  the  interference,  if  we  modify  the 
tinplate,  the  aiming  point  will  be  gradually  moved  out  of  the  target  area 
by  the  defilade  as  the  correlation  matching  is  processing.  To  avoid  that, 
the  teo^late  is  modified  only  when  the  correlation  matching  is  larger  thaui 
the  revision  threshold,  instead  of  frame  by  frame.  This  is  shown  in  Fig. 
3. 

1.  Data  bus 


4 


2.  Template  memory 

3.  Address  mapping 

4.  Seaurchlng  area  memory 

5.  M2U}  computation 

6.  Matching  point  selection 


Figure  3 


4.  The  results  of  computer  processing 

To  test  If  the  loiage  correlation  matching  Is  .practical^  we 
programmed  a  C  program  to  process  the  correlation  matching.  We  used  these 
programs  to  process  the  Infreured  Image  of  an  airplane.  The  Image  data  Is 
saved  In  8  bit  data  format.  First  two  continuous  frames  of  an  airplane 
Image  are  acquired,  then  a  small  psurt  of  the  center 
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eirea  In  the  first  frame's  plane  body  Is  selected  as  the  template,  and  the 
center  area  In  the  second  frame  Is  selected  as  seeurchlng  area.  The 
processing  procedure  Is  divided  Into  two  parts,  one  is  coeurse  matching  ( 
large  distance  betvieen  the  matching  points)  and  another  part  Is  fine 
matching  (  small  distance  between  the  matching  points).  The  results  we 
obtained  are  satisfactory.  The  maximum  matching  error  In  the  coetrse 
matching  is  2‘v/!r  pixel  distance  and  in  the  fine  part  Is  "\/T \  pixel 
distance. 

Fig.  4  Is  the  flow  chart  of  the  C  program,  and  Fig.  5  shows  the  conqniter 
processing  results. 
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5  .  Conclusions 

By  analyzing  the  algorithm  and  processing  the  software,  it  is  found 
that  the  correlation  matching  procedure  is  computationally  very  expensive. 
But  this  image  processing  method  is  strongly  required  for  real-time 
operation.  That  means  a  sin^ler,  precise  algorithm  is  needed.  At  the 
same  time,  the  huge  hardware  circuits  are  a  difficulty  for  application. 

To  iaq>rove  the  cooqmtational  speed,  the  correlation  matching 
procedure  can  be  divided  into  two  stages:  coarse  oiatching  stage  and  fine 
matching  stage.  The  purpose  of  the  cocurse  matching  is  to  quickly  and 
precisely  find  a  rough  matching  point  which  is  called  the  coarse  matching 
point.  After  that,  the  correlation  matching  is  cooqnited  point  by  point  in 
the  area  (i.e.  3  *  3  or  4  *  4)  around  the  coarse  matching  point  found 
before,  in  this  way,  the  matching  point  can  be  found  very  fast. 

Thus,  in  the  cocurse  matching  stage  (assume  the  distance  between 
matching  point  is  k),  we  need  only  Q  »  { (M  -  m)  /  k  +  1)  x  (N  -  n)  /  k  + 
1)  HAD  computations  . 

In  the  fine  matching  stage  (assume  searching  in  the  s  *  t  array)  , 
only  R  «  s  *  t  MAD  cos^tations  are  needed.  The  culdition  of  them  is  : 
Q+R  »((M-m)/k+l)  X  ((N-n)/k+l)  +  s  x  t  «  P  «  (M-m+1)  x  (N-n+1) 

It  is  obvious  that  the  computations  are  reduced  greatly. 

Because  the  coarse  matching  also  has  a  good  matching  accuracy  rate, 
we  can  improve  the  correlation  processing  speed  cmd  only  slightly  affect 
on  the  matching  accuracy  by  using  the  coarse  and  fine  combined  matching 
method. 

In  hardware  circuits  we  can  use  a  FP6A  on-site  l2u:ge  scale 
programmable  gate  array.  The  packing  of  FP6A  devices  usually  are  square 
shaped  with  68  or  84  pins.  It  has  vexry  strong  digital  logic,  processing 
ability.  This  c£ui  greatly  reduce  the  hardware  circuits  scale  and  still 
satisfy  the  specifications  of  any  real  system. 

Due  to  the  limitation  of  article  length,  I  cannott  go  into  more 
detail.  I  appreciate  any  suggestions  or  criticism  about  this  article. 
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1.  Program  initialization 


2.  Con^ile  data  for  the  first  image  frame 

3.  Initialize  the  points  of  the  first  correlation 

4.  Select  template  area  and  save  template  data 

5.  Compile  data  for  the  second  image  frame 

6.  Select  searching  area  and  save  searching  area  data 

7.  Coarse  or  fine  matching? 

8.  update  coarse  matching  address 

9.  update  fine  matching  address 

10.  MAD  computation 

11.  End  correlating? 

12.  Find  the  minimum  value  of  MAD 

13.  Is  this  the  minimum  value  of  MAD? 

14.  This  is  the  matching  point 

15.  Keep  the  matching  point  of  the  previous  frame 

16.  Set  the  model  of  coarse  and  fine  matching 

17 .  Coarse 

18 .  Fine 
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MAD  point: 
match  step=  4 
natch  accuracy;  rough 
nodule  px  d  py;  28  ...  26 
search  px  d  py:  28  ...  24 
dlt  px  d  py:  0  ...  -2 
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MAD  point: 
match  stcp=  1 
natch  accuracy;  refine 
module  px  d  py:  28  . . . 
search  px  d  py:  28  ... 
dlt  px  d  py:  0  ...  B 
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Figure  5 
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